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TITLE OF THE INVENTION 



COMMUNICATION APPARATUS AND METHOD, AND STORAGE MEDIUM 

BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to a communication ap- 
paratus and method, and a storage medium. 

Description of the Related Art 

Conventionally, a remote monitoring system using a 
plurality of cameras includes a plurality of video cameras, 
and a synthesizer for performing analog synthesis of images 
from these cameras. Such a system is utilized within a rela- 
tively small building, and is called a local monitoring sys- 
tem. In contrast to such local monitoring systems, remote 
monitoring systems have been proposed, in which a plurality 
of cameras are connected to a digital network, such as a LAN 
{local area network), an ISDN (integrated services digital 
network), serving as a public digital network, or the like, 
in order to provide a more flexible system and to connect a 
larger number of cameras which are present at more remote 
locations • 

In some of recent remote monitoring systems, a personal 
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computer or a work station is utilized as a monitoring ter- 
minal, and image display using a graphical user interface 
(GUI), and system control are realized. By utilizing the GUI 
of the computer on the monitoring terminal, even a person 
5 who is not familiar with the apparatus can easily deal with 
the system. Particularly, by displaying a control panel of a 
camera which outputs an image, on a monitor together with an 
image from the camera, the operability of the system can be 
improved . 

10 For example, a summary of images from a plurality of 

cameras, or the details of an image from a specific camera 
may be displayed as an image to be displayed in the conven- 
tional system of this type. However, the operability of the 
display operation and the capability to identify the state 

15 of the system are not always excellent. Therefore, there is 
room for improvement. 

Consider a case in which images from a plurality of 
cameras are displayed and the processing speed of the 
monitoring terminal is not so high. 

20 The monitoring terminal sequentially expands and dis- 

plays a received compressed images from a plurality of 
cameras. However, when the calculation speed of the monitor- 
ing terminal is not so high, the frame rate of the displayed 
image from each camera is, in some cases, reduced. Further- 

25 more, when the network does not have a sufficient capacity 
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for the transmitted image, the frame rate is also reduced. 

As a result, the operator erroneously recognizes that 

there is an abnormality in the monitoring terminal because a 

change in the displayed image is small. In another case, 
5 even if there is no change in the displayed image because 

there is an abnormality in the monitoring terminal, the 

operator does not recognize the abnormality and fails to 

correctly monitor the image. 

This problem arises not only when the number of cameras 
10 is large, but also when the resolution of the image received 

from each camera is high although the number of cameras is 

small . 

SUMMARY OF THE INVENTION 

15 

It is an object of the present invention to solve the 
above-described problems . 

It is another object of the present invention to 
provide a communication apparatus and method including a UI 
20 (user interface) which can be more flexibly used, par- 
ticularly, to provide a communication apparatus and method, 
and a storage medium capable of clearly indicating the state 
of transfer of an image which changes depending on situa- 
tion . 

25 It is still another object of the present invention to 



provide a new function. 

According to one aspect of the present invention, a 
communication apparatus includes reception means for receiv- 
ing images generated from a plurality of communication ter- 

5 minals, output means for outputting the images received by 
the reception means in order to dipslay the images on a dis- 
play unit as multiple images, and notification means for 
grasping and notifying a state of reception of the images by 
the reception means. 

10 According to another aspect of the present invention,, a 

communication method includes the steps of receiving images 
generated from a plurality of communication terminals, out- 
putting the received images in order to dipslay the images 
on a display unit as multiple images, and grasping and 

15 notifying a state of reception of the received images. 

According to still another aspect of the present inven- 
tion, a communication apparatus includes reception means for 
receiving a part or all of images generated from image gen- 
eration units of a plurality of corresponding communication 

20 terminals by switching the images, output means for output- 
ting the images received by the reception means in order to 
display the images on a display unit as multiple images, as- 
signing means for assigning an arbitrary image from among 
the multiple images, control means for controlling a state 

25 of outputting the image assigned by the assigning means, and 



notification means for grasping and notifying a state of 
reception of the image by the control means. 

According to yet another aspect of the present inven- 
tion, a communication method includes the steps of receiving 

5 a part or all of images generated from image generation 

units of a plurality of corresponding communication ter- 
minals by switching the images, outputting the received 
images in order to display the images on a display unit as 
multiple images, assigning an arbitrary image from among the 

10 multiple images, controlling a state of outputting the as- 
signed image, and grasping and notifying a state of recep- 
tion of the assigned image. 

According to yet a further aspect of the present inven- 
tion, a storage medium storing a program is provided. The 

15 program includes a reception process code of receiving 
images generated from a plurality of communication ter- 
minals, an output process code of outputting the received 
images in order to dipslay the images on a display unit as 
multiple images, and a notification process code of grasping 

20 and notifying a state of reception of the received images. 

According to still another aspect of the present inven- 
tion, a storage medium storing a program is provided. The 
program includes a reception process code of receiving a 
part or all of images generated from image generation units 

25 of a plurality of corresponding communication terminals by 
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switching the images, an output process code of outputting 
the received images in order to display the images on a dis- 
play unit as multiple images, an assigning process code of 
assigning an arbitrary image from among the multiple images, 
5 a control process code of controlling a state of outputting 

the assigned image, and a notification process code of 
grasping and notifying a state of reception of the assigned 
image . 

The foregoing and other objects, advantages and fea- 
10 tures of the present invention will become more apparent 
from the following detailed description of the preferred em- 
bodiments taken in conjunction with the accompanying draw- 
ings . 

1 5 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a schematic block diagram illustrating the 
configuration of a system according to a first embodiment of 
the present invention; 
20 FI. 2 is a schematic block diagram illustrating the 

configuration of an image transmission terminal 12 shown in 
FIG. 1; 

FIG. 3 is a schematic block diagram illustrating the 
configuration of an image reception terminal (monitoring 
25 terminal) 18 shown in FIG. 1; 



FIG. 4 is a schematic block diagram illustrating the 
configuration of software used in the first embodiment; 

FIG. 5 is a diagram illustrating a monitor picture sur- 
face of the image reception terminal 18; 

FIG. 6 is a diagram illustrating an example of display 
of a map window 60 shown in FIG. 5 on the front of which a 
map 60c is displayed; 

FIG. 7 is a diagram illustrating start of image 
display/image information display; 

FIG. 8 is a diagram illustrating an example of the 
shape of a mouse cursor during an operation to start image 
display ; 

FIG. 9 is a diagram illustrating a camera icon being 
displayed ; 

FIG. 10 is a flowchart illustrating processing for 
turning off a power supply; 

FIG. 11 is a diagram illustrating an operation for 
changing an image display region; 

FIG. 12 is a diagram illustrating an operation for in- 
terrupting image display; 

FIG. 13 is a diagram illustrating an image display win- 
dow 64 in a gaze mode; 

FIG. 14 is a diagram illustrating a panel for setting 
picture quality; 

FIG. 15 is a diagram illustrating actual display in an 
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image information display region; 

FIG, 16 is a flowchart illustrating image information 
display processing; 

FIG. 17 is a schematic block diagram illustrating the 
5 configuration of the image transmission terminal 12 to which 

a plurality of video cameras are connected via a synthesizer 
and a switcher, according to a second embodiment of the 
present invention; 

FIG. 18 is a diagram illustrating a picture surface in 
10 a summary image mode when images from the image transmission 
terminal 12 to which the plurality of video cameras are con- 
nected via the synthesizer and the switcher are synthesized 
and displayed; 

FIG. 19 is a diagram illustrating a picture surface in 
15 a summary image mode when only one image is selected and 
displayed from among images from the image transmission ter- 
minal 12 to which the plurality of video cameras are con- 
nected via the synthesizer and the switcher; 

FIG. 20 is a diagram illustrating a picture surface 
20 when a single image display window is popped up; 

FIG. 21 is a diagram illustrating a picture surface in 
a single-image display mode when only one image is selected 
and displayed from among images from the image transmission 
terminal 12 to which the plurality of video cameras are con- 
25 nected via the synthesizer and the switcher; 



FIG. 22 is a diagram illustrating a picture surface in 
a single-image display mode when images from the image 
transmission terminal 12 to which the plurality of video 
cameras are connected via the synthesizer and the switcher 
are synthesized and displayed; 

FIG. 23 is a flowchart illustrating processing for 
turning off a camera power supply during switcher 
connection; and 

FIG. 24 is a flowchart illustrating processing for 
turning on the camera power supply during switcher connec- 
tion. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

A first embodiment of the present invention will now be 
described in detail with reference to the drawings. 

FIG. 1 is a schematic block diagram illustrating the 
configuration of a system according to the first embodiment. 

In FIG, 1, reference numeral 10 represents a digital 
network performing digital transmission of image data and 
camera control information (including status information), 
to which n image transmission terminals 12 (12-1 - 12-n) are 
connected. Video cameras 16 (16—1 — 16-n) are connected to 
the image transmission terminals 12 (12-1 - 12-n) via camera 
control devices 14 (14-1 - 14-n), respectively. The camera 
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control devices 14 (14-1 - 14-n) control panning, tilting, 
zooming, focusing, diaphragms and the like according to con- 
trol signals from the image transmission terminals 12 (12-1 
- 12-n), respectively. The video cameras 16 (16-1 - 16-n) 
5 are supplied with electric power from the camera control 
devices 14 (14-1 - 14-n), so that the camera control devices 
14 (14-1 - 14-n) can control on/off of power supplies of the 
video cameras 16 (16-1 - 16-n) according to external control 
signals, respectively. 
10 Image reception terminals (monitoring terminals) 18 

(18-1 - 18-m) for receiving and displaying image information 
transmitted from the image transmission terminals 12 (12-1 - 
12-n) are also connected to the network 10. Monitor displays 
(hereinafter abbreviated as "monitors") 20 (20-1 - 20-m) are 
15 connected to the image reception terminals 18 (18-1 - 18-m), 
respectively. 

The image transmission terminals 12 (12-1 - 12-n) 
compress output images from the connected video cameras 16 
(16-1 - 16-n) according to a predetermined compression 

20 method, such as H.261 or the like, and transmit resultant 
signals to an image reception terminal 18 requesting images 
or to all the image reception terminals 18 via the network 
10. The image reception terminals 18 which have received the 
images display the received images on image dipslay regions 

25 of the corresponding monitors 20. The image reception ter- 
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minals 18 can control various parameters (the photographing 
azimuth, the photographing magnification, focus, the stop 
value and the like) of an arbitrary camera 16 via the net- 
work 10, the corresponding image transmission terminal 12 

5 and camera control device 14, as well as electric power 
supply (from an on-state to an off-state, or vice versa). 
The details of these operations will be described later. 

By providing the image transmission terminal 12 with a 
monitor, and an image expansion device for expanding a 

10 compressed image, the image transmission terminal 12 can 
operate as an image reception terminal. Similarly, by con- 
necting the camera control device 14 and the video camera 16 
to the image reception terminal 18 and providing an image 
compression device, the image reception terminal 18 can 

15 operate as an image transmission terminal. It is, of course, 
necessary to provide software necessary for image transmis- 
sion or image reception. 

FIG. 2 is a schematic block diagram illustrating the 
configuration of the image transmission terminal 12. 

20 In FIG. 2, there are shown a CPU (central processing 

terminal) 22 for controlling the entire terminal, a main 
storage 24, a detachable external storage 26, such as a 
floppy disk, a CD{ compact disc ) -ROM ( read-only memory) or the 
like, a secondary storage 28, such as a hard disk or the 

25 like, a mouse 30 serving as a pointing device, and a 
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keyboard 32. The camera control device 14 is connected to an 
I/O (input/output) board 34 for transmitting/receiving 
camera control signals. A video capture device 36 receives a 
video output signal from the video camera 16. The video 

5 capature device 36 of the first embodiment has the A/D 

(analog-to-digital) conversion function of converting an 
analog video signal into a digital signal, and the image 
compression function of compressing information. A video 
board 38 displays image information on the picture surface 

10 of a monitor 40. There are also shown a network interface 
42, and a system bus 44 for interconnecting the devices 22 - 
38, and 42. 

When the image transmission terminal 12 is dedicated 
only for image transmission, the video board 38 and the 
15 monitor 40 can be, in some cases, omitted. 

As can be understood from the foreging description, the 
image transmission terminal 12 is a computer. According to 
the above-described configuration, the image transmission 
terminal 12 transmits an image to a remote monotoring ter- 
20 minal via the network 10, and controls the camera 16 by 
receiving camera control signals from the monitoring ter- 
minal . 

FIG. 3 is a schematic block diagram illustrating the 
configuration of the image reception terminal (monotoring 
25 terminal) 18. 
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In FIG. 3, there are shown a CPU 122 for controlling 
the entire terminal, a main storage 124, a detachable exter- 
nal storage 126, such as a floppy disk, a CD-ROM or the 
like, a secondary storage 128, such as a hard disk or the 

5 like, a mouse 130 serving as a pointing device, and a 

keyboard 132. A video board 132 displays image information 
on the picture surface of a monitor 140. There are also 
shown a network interface 142, and a compression decoder 144 
for expanding compressed image information. A system bus 146 

10 interconnects the devices 122 - 132, 138, 142 and 144. 

The image reception terminal 18 has the same configura- 
tion as the image transmission terminal 12 shown in FIG. 2, 
except that the decoder 144 for expanding a compressed image 
is provided, and system software differs. Some or all of the 

15 image reception terminals 18 can provide an arbitrary image 
transmission terminal 12 or an image transmission terminal 
12 for which camera control is allowed with a camera control 
signal. The image transmission terminal 12 which has 
received the camera control signal controls the correspond- 

20 ing camera 16 in accordance with the contents of the camera 
control signal, and transmits the current state of the 
camera 16. The image reception terminal 18 displays the 
state of the camera 16 on the monitor 140 in accordance with 
the received state signal. At the same time, the image 

25 reception terminal 18 receives and expands image data trans- 
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mitted from the image transmission terminal 12, and displays 
an image represented by the resultant image data on the pic- 
ture surface of the monitor 140 in real time, 

FIG. 4 illustrates the configuration of software used 

5 in the first embodiment. A camera control client (software) 

50 for performing remote control of the camera 16 connected 
to the image transmission terminal 12 which is connected to 
the network 10, image reception software 52 for expanding 
compressed image data from the image transmission terminal 

10 12 and displays an image represented by the resultant image 
data on the picture surface of the monitor, and map control 
software 54 for displaying the disposed position and the 
current state of each camera 16 on a map as a camera symbol, 
and an operation panel for operating each camera 16 are in- 

15 stalled in the image reception terminal (monitoring 
terminal) 18. 

The image reception software 52 controls the cameras 16 
connected to all the image transmission terminals 12 which 
are connected to the network 10, and includes fixed informa- 

20 tion and various types of changing information (for example, 
the name of each camera 16, the name of the host computer to 
which each camera 16 is connected, the state of each camera 
16, such as panning/tilting, zooming or the like, whether 
each camera 16 is controllable, the camera 16 which is cur- 

25 rently controlled, the camera 16 providing the currently 
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displayed image, and the state of image distribution, such 
as the frame rate or the like). The image reception software 
52 utilizes such information for image information display 
and the like. Such information is also supplied to the 

5 camera control client 50 and the map control software 54, 
and is utilized, for example, for changing the display of 
the camera symbol. 

A camera control server 56 for controlling the camera 
16 via the camera control device 14 in accordance with a 

10 request from the camera control client 50 and notifying the 
requester of the current state of the camera 16, and image 
transmission software 58 for compressing an output image 
from the camera 16 and transmitting the resultant image to 
the requester via the network 10 in a predetermined format 

15 are installed in the image transmission terminal 12. 

FIG. 5 illustrates an example of the contents of dis- 
play on the picture surface of the monitor 140 of the image 
reception terminal 18. 

In FIG. 5, a map window 60 shows the layout of an of- 

20 fice, a shop, a warehouse or the like where the camera 16 is 
disposed. A plurality of maps 60a, 60b, 60c and 60d can be 
switched on the map window 60. The number of the maps 60a, 
60b, 60c and 60d which can be displayed depends on the per- 
formance of the system, and is not particularly limited. A 

25 tag is provided for each of the maps 60a, 60b, 60c and 60d. 
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By clicking a tag by a mouse pointer, the map having the 
selected tag is dipslayed on the front of the picture sur- 
face. Camera icons (camera symbols) 62a, 62b, 62c and 62d 
indicating respective disposed cameras are also displayed on 

5 the map displayed on the front surface. The camera icons 
62a, 62b, 62c and 62d are displayed in the directions of the 
corresponding cameras 16. 

An image display window 64 includes a plurality of 
image display regions 66a - 66f. Although in the first em- 

10 bodiment, six image display regions are shown, the number of 
the image display regions is, of course, not limited to six. 
A dustbin icon 66g for an operation of interrupting display 
of an image being displayed is also displayed on the image 
display window 64. The use of the dustbin icon 66g will be 

15 described later. 

Image information display regions 66h - 66m correspond- 
ing to the image display regions 66a - 66f, respectively, 
are also displayed on the image display window 64. The use 
of the image information display regions 66h - 66m will be 

20 described later. 

The image display window 64 has a display mode in which 
a summary of a plurality of image display regions is dis- 
played as shown in FIG, 5, and a display mode in which only 
one of the plurality of images is gazed as shown in FIG. 13. 

25 The former mode is termed a summary mode, and the latter 
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mode is termed a gaze mode. The gaze mode can be utilized 
when it is intended to display one image in a large size or 
display the details of one image with high resolution. 
Switching between the summary mode and the gaze mode will be 

5 described later. 

A camera control panel 68 includes buttons for operat- 
ing the direction (panning/tilting), zooming and the like of 
an assigned camera. In the first embodiment, the camera con- 
trol panel 68 also includes a camera power supply button 70 

10 for operating on/off of the power supply of an assigned 
camera . 

For example, when the map 60c is selected, and is dis- 
played on the front surface of the map window 60, a map as 
that shown in FIG- 6 is displayed. Camera icons 62e and 62f 
15 indicating two cameras disposed in the map are also dis- 
played . 

The details of camera control in the first embodiment 
will now be described in detail. When intending to display 
an image from a camera 16, an operation of selecting the 

20 camera icon indicating that camera 16 on the corresponding 
map of the map window 60, superposing the selected camera 
icon on one of the image display regions 66a - 66f on the 
image display window 64, and then releasing the camera icon 
(a so-called drag-and-drop operation) is performed. Usually, 

25 an unused region of the image display regions 66a - 66f is 



selected. When the image display region currently being used 
has been selected, a warning of switching of the camera may 
be performed, and the user may be asked to select between 
continuation and interruption. Such processing is well 
known . 

FIG. 7 illustrates a drag-and-drop operation of the 
camera icon 62c onto the image display region 66c. An image 
from the camera represented by the camera icon 62c is dis- 
played on the image display region 66c. While the camera 
icon is dragged, the shape of the mouse cursor changes into 
a shape as that shown in FIG. 8, in order to notify the user 
that the mouse cursor is being dragged for image display. 
The map control software 54 notifies the image reception 
software 52 of an ID of the camera represented by the 
selected camera icon. The image reception software 52 checks 
the direction and the name of the camera, and the name of 
the host computer to which the camera is connected, based on 
the ID, and notifies the camera control client 50 and the 
map control software 54 of information relating to the 
checked items. 

Next, a description will be provided of an operation 
performed when controlling a camera. If an image display 
region displaying an image from a camera to be controlled 
(for example, an image display region 66c) from among the 
image display regions 66a - 66f displaying images is sub- 
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jected to single clicking according to the above-described 
operation, a state in which camera control can be performed 
is provided. At that time, a yellow frame is displayed on 
the image display region 66c, in order to indicate 

5 capability of camera control to the operator. The camera 
control panel 68 is also automatically displayed. 

The camera control client 50 performs network connec- 
tion to the camera control server 56 of the image transmis- 
sion terminal 12 to which the selected camera is connected, 

10 based on information from the image reception software 52. 
Then, the camera control client 50 transmits a camera con- 
trol signal provided based on the user's operation to the 
camera control server 56 subjected to network connection. 
The camera control server 56 controls the camera 16 in ac- 

15 cordance with the received camera control signal, and 
notifies the camera control client 50 of the current infor- 
mation of the camera 16. The camera control client 50 
notifies the image reception software 52 of the current in- 
formation of the selected camera 16. The image reception 

20 software 52 also notifies the map control software 54 of 
that information. 

The map control software 54 changes the direction of 
the camera icon so as to coincide with the direction of the 
corresponding camera 16, displays, as shown in FIG. 9, a 

25 scope 72 indicating that the image is being displayed for 
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the selected camera icon, and also displays a control poin- 
ter 74 for controlling panning/ t i It ing and zooming within 
the scope 72. As described above, changing information 
(particularly, panning/tilting information) of the camera 16 

5 currently being displayed is always notified from the image 
reception software 52 to the map control software 54. The 
map control software 54 changes the direction of the 
selected one of the camera icons 62a - 62f so as to coincide 
with the direction of the corresponding camera, based on the 

10 notified information. 

A single camera control panel 68 may be provided com- 
monly for the image display regions 66a - 66f, or a 
plurality of camera control panels 68 may be provided for 
corresponding ones of the image display regions 66a - 66f . 

15 When providing a plurality of camera control panels 68, by 
providing and displaying respective reference numerals for 
the image display regions 66a - 66f, and providing and dis- 
playing the same reference numerals for the camera control 
panels 68, a system in which correspondence between images 

20 and camera control panels 68 can be easily understood is 
provided. Instead of providing and displaying reference 
numerals, a camera name provided for each camera may be dis- 
played, or different colors may be provided and displayed 
for the image display regions 66a - 66f. 

25 FIG. 10 is a flowchart illustrating processing for 
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turning off the power supply of an arbitrarily selected 
camera 16. When intending to temporarily turning off the 
power supply of the selected camera, an operation of select- 
ing a camera icon indicating the camera whose power supply 

5 is to be turned off, and depressing a camera power supply 

button 70 of the camera control panel 68 is performed. The 
camera power supply button 70 is displayed with a different 
color and/or different characters (for example, "power 
supply off" or "power supply on") in accordance with the 

10 state of the power supply of the concerned camera. In ac- 
cordance with the operation of the camera power supply but- 
ton 70, the camera control client 52 notifies the camera 
control server 56 of the image transmission terminal 12 to 
which the corresponding camera 16 is connected of a request 

15 to turn off the camera power supply via the network 10 (step 
SI). 

The camera control server 56 controls the camera con- 
trol device 14 via the I/O board 34 in order to disconnect 
electric power supply to the corresponding video camera 10 
20 (step S2). The camera power supply button 70 is changed to a 
display state indicating that the power supply is in an off- 
state (step S3). Thus, the operator is notified that the 
power supply of the corresponding camera is in an off-state. 
When intending to resvime electric power supply to the 
25 camera whose power supply is in an off-state, the operation 



- 22 - 

of again depressing the camera power supply button 70 may be 
performed. Thus, a request to turn on the camera power 
supply is notified to the camera control server 56, and 
electric power is supplied to the corresponding video camera 
5 16. At that time, the camera power supply button 70 is 

changed to a color indicating that the power supply is in an 
on-state . 

Thus, it is possible to control electric power supply 
to an arbitrary camera from the monitoring terminal 18, and 

10 to reduce power consumption. 

In response to a request to transmit an image from the 
image reception software 52, the image transmission software 
58 transmits an image from an assigned camera. That is, the 
image reception software 52 requests the image transmission 

15 software 58 of the image transmission terminal 12 to which 
the selected camera is connected to transmit image data for 
one frame via the network 10. In response to this request, 
the image transmission software 58 compresses image data of 
the latest frame from the camera 16 and divides the 

20 compressed data into packets, and transmits the packets to 
the image reception software 52 which has requested data 
transmission. The image reception software 52 reconstructs 
frames from the received packets, expands the compressed 
data, displays the resultant data on an assigned region from 

25 among the image display regions 66a - 66f , and again 
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provides an image transmission request. By repeating such an 
operation, the image reception terminal 18 receives images 
from a remote camera, and displays the received images. 

When intending to simultaneously display images from a 

5 plurality of cameras, provision of an image transmission 
request and reception/display of an image is repeatedly ex- 
ecvited for the image transmission software 58 of the image 
transmission terminal 12 to which each camera is connected. 

The position of the received image from a camera can be 

10 changed by a drag-and-drop operation. For example, when in- 
tending to change the image region from the image display 
region 66c to the image display region 66b, as shown in FIG. 
11, the mouse button is depressed after moving the mouse 
pointer onto the image display region 66c. Then, the mouse 

15 pointer is moved onto the image display region 66b while 
depressing the mouse button, and the mouse button is 
released on the image display region 66b, 

In accordance with such an operation, the image recep- 
tion software 52 stops image display of the image display 

20 region which has originally been selected (the region 66c in 
the case of FIG. 11), and the image from the camera dis- 
played on that image display region is allocated to the 
image display region which has subsequently been selected 
(the region 66c in the case of FIG. 11). Logical network 

25 connection is not disconnected by this operation. 
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In the summary mode, when intending to gaze at an image 
in a certain image display region (for example, the region 
66a), this image display region is subjected to double 
clicking by the mouse. The image display window 64 is 

5 thereby switched to the gaze mode of gazing at this image. 

FIG, 13 illustrates the image display window 64 in the gaze 
mode. A window 80 is termed a gaze display window. A mode 
switching button 82 is used for returning to the summary 
mode. Camera control direction cursors 84a, 84b, 84c and 84d 

10 are used when performing camera control. 

In the gaze mode, one image is displayed in a large 
size. At that time, it is possible to select one of display 
with smooth movement in which priority is given to the dis- 
play speed (frame rate), and high-resolution display in 

15 which the amount of data per frame is increased by giving 
priority to the picture quality. FIG. 14 illustrates a win- 
dow for setting the pictvire quality for performing such 
selection. In FIG, 14, reference numeral 90 represents a 
button for giving priority to the display speed, and 

20 reference numeral 92 represents a button for giving priority 
to the picture quality. Only one of the d i spl ay- spe ed 
priority button 90 and the picture-quality priority button 
92 can be selected. 

Next, the operation performed when shifting to the gaze 

25 mode in a state in which the picture-quality priority button 
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92 is selected will be described in detail. First, the image 
reception software 52 notifies the image transmission 
softvare 58 of the corresponding image transmission terminal 
12 of a request of high resolution via the network 10. Upon 

5 reception of the request of high resolution, the image 

transmission software 58 switches the resolution of an image 
to be transmitted to high resolution. The image reception 
software 52 receives the high-resolution image and displays 
the image on the gaze display window 80. At that time, since 

10 the high-resolution image has a larger amount of data than a 
basic-resolution image, the display speed is, in some cases, 
reduced . 

By depressing the mode switching button 82 or perform- 
ing double clicking of the gaze display window 80 with the 

15 mouse, the image display window 64 returns to the summary 
mode. The image reception software 52 notifies the image 
transmission software 58 of the corresponding image trans- 
mission terminal 12 of a request of basic resolution via the 
network 10. Upon reception of the request of basic resolu- 

20 tion, the image transmission software 58 returns the resolu- 
tion of an image to be transmitted to basic resolution. 

Next, a description will be provided of the operation 
performed when shifting to the gaze mode in a state in which 
the display-speed priority button 90 is selected. In this 

25 case, the image reception software 52 notifies the image 
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transmission software 58 of nothing. The image reception 
software 52 performs magnified display of the image trans- 
mitted with basic resolvition on the gaze display window 80. 
The operation for returning to the summary mode is the same 
5 as when the picture-quality priority button 92 is selected. 

Although in the foregoing description, mode switching 
is performed by controlling the resolution of the image, the 
compression ratio or the transfer rate of the image may also 
be controlled. 

10 Next, a description will be provided of the operation 

performed when controlling a camera in the gaze mode. In the 
gaze mode, as in the summary mode, the movement of the 
camera can be controlled using the camera control panel 68. 
In addition, by continuing to depress the button of the 

15 mouse within the gaze display window, the camera can be con- 
trolled. In FIG. 13, the mouse cursor changes to one of the 
camera direction control cursors 84a - 84d as the mouse cur- 
sor is positioned at the corresponding one of four regions 
divided by four broken lines in the gaze display window 80. 

20 Furthermore, by depressing the button of the mouse in each 
region, the camera is controlled in one of the four direc- 
tions, i.e., upward, downward, rightward and leftward direc- 
tions . 

In accordance with an instruction to change to the gaze 
25 mode, communication with terminals other than the image 
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transmission terminal assigned in the gaze mode may be in- 
terrupted, and the mode may be shifted to a picture-quality 
priority mode or a display-speed priority mode. 

As a result, in the gaze mode, by allocating a wide 

5 network to the assigned terminal and performing communica- 

tion of a high-resolution image or an image having a high 
frame rate using the allocated network, the picture quality 
can be improved . 

When intending to interrupt image display, an operation 

10 of putting an image to be displayed on the image display 
region to be interrupted into the dustbin icon 66g may be 
performed. FIG. 12 illustrates a case in which display of an 
image displayed on the image display region 66c is inter- 
rupted. The mouse button is depressed after moving the mouse 

15 pointer onto the image display region 66c, the mouse pointer 
is moved onto the dustbin icon 66g while depressing the 
mouse button, and the mouse button is released on the 
dustbin icon 66g. 

In accordance with such an operation, the image recep- 

20 tion software 54 interrupts provision of a request of image 
transmission to the image transmission software 58 of the 
image transmission terminal to which the camera providing 
the image displayed on the selected image display region 
I the region 66c in the case of FIG. 12) is connected. In ad- 

25 dition, the image reception software 54 notifies the camera 
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control client 50 and the map control software 54 of inter- 
ruption of image display. In response to this notification, 
the camera control client 50 disconnects network connection 
with the camera control server 56 of the corresponding image 
5 transmission terminal 12 in order to clear the concerned 

image display region {the region 66c in the case of FIG. 
12). The map control software 54 erases scope display of the 
camera icon of the corresponding camera (for example, the 
icon 62c), to update the map. 
10 In FIG. 7, the image from the camera represented by the 

camera icon 62c is displayed on the image display region 
66c, and an image information display region 66 j correspond- 
ing to the region 66c also displays image information. The 
image information displayed at that time is an icon as that 
15 shown in FIG. 15. The icon flashes every time an image for 
one frame is transmitted from the camera 16 corresponding to 
the image display region 66c. Instead of displaying only the 
image information display region 66j corresponding to the 
assigned image display region 66c, image information display 
20 regions 66h - 66m corresponding to all the image display 
regions 66a - 66f performing image display may be displayed. 
The displayed image information is not limited to the icon 
shown in FIG. 15. For example, numerical information or 
character information indicating the frame rate or the like 
25 may also be displayed. The image information can be dis- 
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played not only in the summary mode, but also, of course, in 
the above-described gaze mode. 

FIG. 16 is a flowchart illustrating processing for dis- 
playing image information. Image processing is realized, for 

5 example, by an event loop (step SOI). When there is a dis- 
played image-region group, every time an image for one frame 
is transmitted from the corresponding camera 16 and the 
image display region is updated in each of the image regions 
66a - 66f (step S02 ) , the corresponding image information 

10 display region is displayed (step S03). Flashing of an icon 
can be realized according to a conventional ordinary proce- 
dure. When the image from the camera represented by the 
camera icon 62c is dragged onto the image display region 66c 
(step S04 ) , the image display region 66c is added to the 

15 displayed image-region group (step 805), and the correspond- 
ing image information region 66 j is displayed (step 303). 

In the first embodiment, by performing a drag-and-drop 
operation of the camera symbol on the map onto the image 
display region, logic network connection between the image 

20 reception terminal and the image transmission terminal can 
be established. By performing a drag-and-drop operation be- 
tween the image display region displaying the image from the 
camera and another arbitrary image display region, the posi- 
tion of image display can be changed. By performing a drag- 

25 and-drop operation from the image display region displaying 
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the image from the camera to a symbol representing inter- 
rut ion of display, image display can be interrupted. Thus, 
start of display of the image from the camera, a change in 
the display position, and interruption of display can be 
5 very simply operated. The image is not limited to an image 
from a camera, but may, of course, also be an image gen- 
erated from a storage medium, such as a video tape or the 
like. 

By flashing the icon every time the image from the 
10- camera is updated in the image information display region, 
the property to confirm that even an image having little 
movement (image difference) is normally received and is 
operating can be easily improved. 

A case in which the image information display regions 
15 66h - 66m are always displayed has been described. However, 
by taking into consideration that, when the frame rate is 
high, flashing of the icon is, in some cases, a nuisance, 
and reception of an image can be easily confirmed by seeing 
the image, dislay may be performed in the image information 
20 display region only when the frame rate is low and there is 
the possibility that the operator erroneously finds some 
kind of abnormality. 

A second embodiment of the present invention will now 
be described. 

25 FIG. 17 is a schematic block diagram illustrating the 
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configuration of an image transmission terminal to which a 
switcher and a synthesizer are connected. In FIG. 17, com- 
ponents having the same configurations as those shown in 
FIG. 2 are indicated by the same reference numerals, and 

5 further description thereof will be omitted. 

In FIG. 2, a video camera is connected to each com- 
puter. In FIG. 17, however, four camera control devices 14a 
- 14d and four video cameras 16a - 16d are connected to a 
computer via a switcher 101 and a synthesizer 102. 

10 First, the synthesizer 102 will be described. The syn- 

thesizer 102 performs image synthesis of analog moving sig- 
nals from the video cameras 16a - 16d as represented by a 
frame 66a shown in FIG. 18. Furthermore, by transmitting a 
command from the computer to the synthesizer 102 via the 

15 switcher 101, a moving signal from a video camera can be 
selectively displayed as indicated by a frame 66a shown in 
FIG, 19, 

Next, the switcher 101 will be described. In FIG. 17, 
in contrast to FIG. 2, the four camera control devices are 

20 connected. When controlling a video camera, the computer 
must perform switching of the camera control devices 14a - 
14d, The switcher 101 is used for such switching. As 
described above, by transmitting a command to the syn- 
thesizer 102, it is possible to select one of moving signals 

25 from the video cameras, or synthesize and display the moving 
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signals . 

When controlling the video camera 16 via the switcher 
101 as shown in FIG. 17, the camera control server 56 shown 
in FIG. 4 transmits a command for selecting a video camera 

5 to be controlled to the switcher 101, in order to perform 
switching to the corresponding camera control device. Then, 
in accordance with a request from the camera control client 
50 shown in FIG. 4, the video camera is controlled via the 
switcher 101 and the camera control device 14 as in the 

10 first embodiment. 

FIG. 18 shows an example of the contents of display on 
the monitor of the image reception terminal 18 in the second 
embodiment . 

In FIG. 18, reference numeral 110 represents a single 
15 image display mode button. When this button is clicked, as 
represented by a frame 111 shown in FIG. 20, a window is 
newly popped up, and only the selected image is displayed in 
the form of moving images. According to an instruction 
through the single image display mode button, a command to 
20 interrupt image communication with terminals other than the 
image transmission terminal transmitting the assigned image 
is transmitted to the terminals other than the image trans- 
mission terminal transmitting the assigned image, a command 
for improvement in the frame rate in order to efficiently 
25 utilize an avaiable network capacity provided due to inter- 
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ruption of image communication, or a command for improvement 
in resolution is transmitted to the image transmission ter- 
minal transmitting the assigned image. 

It is determined by initial setting by the user whether 

5 a command for improvement in the frame rate or a command for 

improvement in resolution is to be transmitted according to 
an instruction through the single image display mode button. 

In FIG. 18, there are also shown a four-image silmul- 
taneous display button 112 and a selection display button 

10 113. These buttons become effective only when an image from 
the image transmission terminal to which the four video 
cameras are connected is selected by the synthesizer and the 
switcher shown in FIG. 17. Suppose that the image displayed 
in the frame 66a of the image display window 64 is an image 

15 from the image transmission terminal shown in FIG. 17. By 
selecting the frame 66a by the mouse, the four-image simul- 
taneous display button 112 and the selection display button 
113 become effective. 

For example, when four images are simultaneously dis- 

20 played as shown in FIG. 18, the lower right image is clicked 
from among the four displayed images. By then clicking the 
selection display button 113, an image as shown in FIG. 19 
is obtained. By clicking the frame 66a in a state of display 
as shown in FIG. 19, and then clicking the four-image simul- 

25 taneous display button 112, a state as shown in FIG. 18 is 
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obtained . 

Next, the operation performed in the single image dis- 
play mode will be described. By clicking the single image 
display mode button after assigning one of the image display 

5 regions 66a - 66f using the mouse 30, the single image dis- 

play window 111 is popped up as shown in FIG. 20, and the 
selected image is displayed. 

A case of providing the single image display mode for 
an image from the image transmission terminal to which the 

10 four video cameras are connected via the synthesizer and the 
switcher as shown in FIG. 17 will now be considered. An 
image displayed in the frame 66a shown in FIG. 18 or 19 is 
an image from the image transmission terminal. 

When display as shown in FIG. 18 is performed, if the 

15 single image display mode button 10 is clicked, the single 
image display window 111 as shown in FIG. 22 is popped up. 
Since this is an image from the image transmission terminal 
to which the four video cameras are connected via the syn- 
thesizer and the switcher, a four-image simultaneous display 

20 button 112a and a selection display button 113a also appear 
on the single image display window 111. In this case, by 
clicking the selection display button 113a after clicking 
the lower right image shown in FIG. 22 by the mouse, an 
image as shown in FIG. 21 is displayed. 

25 As for display shown in FIG. 21, also, in accordance 
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with a command for improvement in the frame rate or a com- 
mand for improvement in resolution as in the above— described 
case of image change to the single image display mode, a 
visually excellent image is displayed. 

5 When display as shown in FIG. 19 is performed, if the 

single image display mode button 110 is clicked, the single 
image display window 111 as shown in FIG. 21 is popped up. 
Since this is an image from the image transmission terminal 
to which the four video cameras are connected via the syn- 

10 thesizer and the switcher, the four-image simultaneous dis- 
play button 112a and the selection display button 113a also 
appear on the single image display window 111. In this 
state, by clicking the four-image simultaneous display but- 
ton 112a by the mouse, a frame where four images are simul- 

15 taneously displayed appears as shown in FIG. 22. 

In the second embodiment, even in the simple image dis- 
play mode, it is possible to perform synthesis display or 
selective display of images from the image transmission ter- 
minal to which the four video cameras are connected via the 

20 synthesizer and the switcher. Hence, it is possible to per- 
form synthesis display or selective display of images 
without being aware of whether the current mode is the 
single image display mode or the summary image display mode. 
When the image displayed on frame 66a of the image dis- 

25 play window 64 comprises four simultaneously displayed 



- 36 - 



images shown in FIG. 18 from the image transmission terminal 
including the switcher 101 as shown in FIG. 17, image infor- 
mation in image information display regions 66n - 66q cor- 
responding to the cameras 16a - 16d, respectively, is also 
displayed. Each displayed image information at that time is 
an icon as shown in FIG. 15, which flashes every time an 
image for one frame from one of the cameras 16a - 16d cor- 
responding to the image display region 66a is transmitted. 
Instead of displaying only the image information display 
region from among the image information display regions 66m 
- 66q corresponding to the assigned image display region 
66a, image information display regions 66h - 66q correspond- 
ing to all the image display regions 66a - 66m performing 
image display may be displayed, as in the first embodiment. 
The displayed image information is not limited to the icon 
shown in FIG. 15. For example, numerical information or 
character information indicating the frame rate or the like 
may also be displayed. The image information is displayed 
not only in the summary mode, but also, of course, in the 
above-described gaze mode. 

When the image displayed in the frame 66a of the image 
display window 64 is a selected image shown in FIG. 19 from 
the image transmission terminal including the switcher 101 
as shown in FIG. 17, image information in an image informa- 
tion display region 66r corresponding to one of the cameras 



16a - 16d is also displayed. Each displayed image informa- 
tion at that time is an icon as shown in FIG, 15, which 
flashes every time an image for one frame from one of the 
cameras 16a - 16d corresponding to the image display region 
66a is transmitted. Instead of displaying only the image in- 
formation display region 66r corresponding to the assigned 
image display region 66a, image information display regions 
66h - 66r corresponding to all the image display regions 66a 
- 66m performing image display may be displayed, as in the 
above-described case. The displayed image information is not 
limited to the icon shown in FIG. 15. For example, numerical 
information or character information indicating the frame 
rate or the like may also be displayed. The image informa- 
tion is displayed not only in the summary mode, but also, of 
course, in the above-described gaze mode. 

When simultaneously displaying four images, also, a 
signal from the synthesizer 102 may be considered to repre- 
sent, an image for one frame, and four images may be dis- 
played on only one image display region 66q. At that time, 
the image display regions 66n - 66p become unnecessary {not 
shown ) . 

FIG. 16 is a flowchart illustrating processing for dis- 
playing image information. Image processing is realized, for 
example, by an event loop (step SOI). When there is a dis- 
played image-region group, every time an image for one frame 
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is transmitted from the corresponding camera 16 and the 
image display region is updated in each of the image regions 
66a - 66f (step S02 ) , the corresponding image information 
display region is displayed (step SOS). Flashing of an icon 

5 can be realized according to a conventional ordinary proce- 

dure. When the image from the camera represented by the 
camera icon 62c is dragged onto the image display region 66c 
(step S04 ) , the image display region 66c is added to the 
displayed image-region group (step 805), and the correspond- 

10 ing image information region 66j is displayed (step S03). 

Next, a description will be provided of processing for 
automatically turning off the power supply of the camera 
during switcher connection. 

The processing for turning off the camera power supply 

15 shown in the flowchart of FIG. 10 is executed by depressing 
the camera power supply button 70 of the camera control 
panel 68. A flowchart shown in FIG. 23 illustrates an ex- 
ample of processing for automatically turning off the power 
supply of the camera 16 which becomes not displayed on the 

20 image display window 64 when switching the camera 16. 

When display as shown in FIG. 18 is performed, if the 
selection display button 113 is clicked, then, as shown in 
FIG. 19, an image from a camera selected from the four 
cameras 16a - 16d connected via the switcher 101 is dis- 

25 played on the image display region 66a (step Sll). Then, the 
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camera control client 52 notifies the camera control server 
56 of the image transmission terminal 12 to which the 
selected camera is connected via the network 10 of a request 
to turn off the camera power supply (step S12). The camera 
control server 56 controls the switcher 101 via the I/O 
board 34 in order to disconnect electric power supply to 
non-selected cameras (step S13), 

Next, a description will be provided of processing for 
automatically turning off the power supply of the camera 
during switcher connection with reference to the flowchart 
shown in FIG. 24, 

As in the case shown in FIG. 23, when image switching 
is present (step S21), it is determined if the power supply 
of the selected camera 16 is turned off (step S22). If the 
result of the determination in step S22 is affirmative, the 
camera control client 52 notifies the camera control server 
56 of the image transmission terminal 12 to which the 
selected camera 16 is connected via the network 10 of a 
request to turn off the power supply of the selected camera 
(step S23). The camera control server 56 controls the swit- 
cher 101 via the I/O board 34 in order to supply the 
selected camera 16 with electric power (step S24). 

According to the above-described configuration, it is 
possible to control electric power supply to nonselected 
cameras 16 from the monitoring terminal 18 via the switcher 
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101, and thereby to reduce electric power consumption. 

When the image displayed on the frame 66a of the image 
display window 64 comprises four simultaneously displayed 
images shown in FIG. 18 from the image transmission terminal 
including the switcher 101 as shown in FIG. 17, image infor- 
mation in image information display regions 66n - 66q cor- 
responding to the cameras 16a — 16d, respectively, is also 
displayed. Each displayed image information at that time is 
an icon as shown in FIG. 15, which flashes every time an 
image for one frame from one of the cameras 16a - 16d cor- 
responding to the image display region 66a is transmitted. 
Instead of displaying only the image information display 
region from among the image information display regions 66m 
- 66q corresponding to the assigned image display region 
66a, image information display regions 66h - 66q correspond- 
ing to all the image display regions 66a - 66m performing 
image display may be displayed, as in the first embodiment. 
The displayed image information is not limited to the icon 
shown in FIG. 15, For example, numerical information or 
character information indicating the frame rate or the like 
may also be displayed. The image information is displayed 
not only in the summary mode, but also, of course, in the 
above-described gaze mode. 

When the image displayed in the frame 66a of the image 
display window 64 is a selected image shown in FIG. 19 from 
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the image transmission terminal including the switcher 101 
as shown in FIG. 17, image information in an image informa- 
tion display region 66r corresponding to one of the cameras 
16a - 16d is also displayed. Each displayed image informa- 

5 tion at that time is an icon as shown in FIG. 15, which 

flashes every time an image for one frame from one of the 
cameras 16a - 16d corresponding to the image display region 
66a is transmitted. Instead of displaying only the image in- 
formation display region 66r corresponding to the assigned 

10 image display region 66a, image information display regions 
66h - 66r corresponding to all the image display regions 66a 
- 66m performing image display may be displayed, as in the 
above-described case. The displayed image information is not 
limited to the icon shown in FIG. 15. For example, numerical 

15 information or character information indicating the frame 
rate or the like may also be displayed. The image informa- 
tion is displayed not only in the svimmary mode, but also, of 
course, in the above-described gaze mode. 

When simultaneously displaying four images, also, a 

20 signal from the synthesizer 102 may be considered to repre- 
sent an image for one frame, and four images may be dis- 
played on only one image display region 66q. At that time, 
the image display regions 66n - 66p become unnecessary (not 
shown ) . 

25 FIG, 16 is a flowchart illustrating processing for dis- 
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playing image information. Image processing is realized, for 
example, by an event loop (step SOI). When there is a dis- 
played image-region group, every time an image for one frame 
is transmitted from the corresponding camera 16 and the 

5 image display region is updated in each of the image regions 

66a - 66f (step S02), the corresponding image information 
display region is displayed (step SOS). Flashing of an icon 
can be realized according to a conventional ordinary proce- 
dure. When the image from the camera represented by the 

10 camera icon 62c is dragged onto the image display region 66c 
(step S04), the image display region 66c is added to the 
displayed image-region group (step 505), and the correspond- 
ing image information region 66 j is displayed (step SOS). 

By flashing the icon every time the image from the 

15 camera is updated in the image information display region, 
the property to confirm that even an image having little 
movement (image difference) is normally received and is 
operating can be easily improved. 

As for an image from a camera distributed by the swit- 

20 cher, by flashing the icon every time the image from the 
camera is updated in the image information display region, 
the property to confirm that even an image having little 
movement (image difference) is normally received and is 
operating can be easily improved. 

25 Particularly when simultaneously displaying four 
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images, the frame rate allocated for one image will be rela- 
tively reduced. Even in such a case, by clearly indicating 
that an image is normally received and is operating, the 
property to confirm normal operation of the image can be 

5 easily improved. 

By clearly indicating image information corresponding 
to each image distributed by the switcher, the state of dis- 
tribution of a plurality of images can be easily confirmed. 

By clearly indicating image information corresponding 

10 to each of four images simultaneously displayed using the 
sw^itcher, the state of distribution of the images can be 
easily confirmed. 

The objects of the present invention may, of course, be 
achieved by supplying a system or an apparatus with a 

15 storage medium storing program codes of software for realiz- 
ing the functions of the above-described embodiments, and 
reading and executing the program codes stored in the 
storage medium by means of a computer (or a CPU or an MPU 
(microprocessor unit)) of the system or the apparatus. 

20 In such a case, the program codes themselves read from 

the storage medium realize the functions of the above- 
described embodiments, so that the storage medium storing 
the program codes constitutes the present invention. 

For example, a floppy disk, a hard disk, an optical 

25 disk, a magnetoopt ical disk, a CD-ROM, a CD-R (recordable). 
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a magnetic tape, a nonvolatile memory card, a ROM or the 
like may be used as the storage medium for supplying the 
program codes. 

The present invention may, of course, be applied not 

5 only to a case in which the functions of the above-described 

embodiments are realized by executing program codes read by 
a computer, but also to a case in which an OS (operating 
system) or the like operating in a computer executes a part 
or the entirety of actual processing, and the functions of 

10 the above-described embodiments are realized by the process- 
ing . 

The present invention may, of course, be applied to a 
case in which, after writing program codes read from a 
storage medium into a memory provided in a function expand- 

15 ing board inserted into a computer or in a function expand- 
ing unit connected to the computer, a CPU or the like 
provided in the function expanding board or the function ex- 
panding unit performs a part or the entirety of actual 
processing, and the functions of the above-described embodi- 

20 ments are realized by the processing. 

As described above, since reception means for receiving 
images generated from a plurality of communication ter- 
minals, output means for outputting the images received by 
the reception means in order to display the images on a dis- 

25 play unit as multiple images, and notification means for 
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grasping and notifying a state of reception of the images by 
the reception means are provided, the operator can easily 
identify the state of reception. 

Since the frame rate of an image being received can be 

5 notified, it is possible to prevent misdeterminat ion by the 
operator as a failure which may occur, for example, when the 
frame rate of the image is small because the speed of the 
network is low or because display processing (display, 
decoding (in the case of a compressed image), and display) 

10 of the communication apparatus is slow. 

The operator can easily recognize the state of recep- 
tion . 

Furthermore, the value of the frame rate can be easily 
conf irmed . 

15 It is possible to perform notification only when there 

is the possibility of misunderstanding of the operator, in 
accordance with the frame rate. 

In addition, the state of reception of images generated 
from a plurality of communication terminals can be easily 

20 identified. 

The individual components shown in outline or desig- 
nated by blocks in the drawings are all well known in the 
communication apparatus and method, and storage medium arts 
and their specific construction and operation are not criti- 

25 cal to the operation or the best mode for carrying out the 
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invention . 

While the present invention has been described with 
respect to what are presently considered to be the preferred 
embodiments, it is to be understood that the invention is 

5 not limited to the disclosed embodiments. To the contrary, 
the present invention is intended to cover various modifica- 
tions and equivalent arrangements included within the spirit 
and scope of the appended claims. The scope of the following 
claims is to be accorded the broadest interpretation so as 

10 to encompass all such modifications and equivalent struc- 
tures and functions. 
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WHAT IS CLAIMED IS: 



1. A communication apparatus comprising: 

reception means for receiving images generated from a 
plurality of communication terminals; 

output means for outputting the images received by said 
reception means in order to dipslay the images on a display 
unit as multiple images; and 

notification means for grasping and notifying a state 
of reception of the images by said reception means. 

2. A communication apparatus according to Claim 1, 
wherein the state of reception is information relating to a 
frame rate of an image being received by said reception 
means . 

3. A communication apparatus according to Claim 1, 
wherein said notification means changes the display unit in 
accordance with the state of reception by said reception 
means . 

4. A communication apparatus according to Claim 1, 
wherein said notification means changes information dis- 
played on the display unit in accordance with a frame rate 
of an image received by said reception means. 



5. A communication apparatus according to Claim 3, 
wherein the change in information displayed on the display 
unit is a change in a state of display of an icon indicating 
a corresponding one of the plurality of communication ter- 
minals . 

6. A communication apparatus according to Claim 4, 
wherein said notification means does not perform notifica- 
tion when the frame rate is high, and performs notification 
when the frame rate is reduced. 

7. A communication apparatus according to Claim 1, 
wherein said notification means comprises one of flashing of 
an icon, display of character information, and display of 
numerals . 

8- A communication method comprising the steps of: 

receiving images generated from a plurality of com- 
munication terminals; 

outputting the received images in order to dipslay the 
images on a display unit as multiple images; and 

grasping and notifying a state of reception of the 
received images. 
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9. A communication method according to Claim 8, wherein 
the state of reception is information relating to a frame 
rate of an image being received. 

10. A communication method according to Claim 8, 
wherein the notification changes the display unit in accord- 
ance with the state of reception. * 

11. A communication method according to Claim 8, 
wherein the notification changes information displayed on 
the display unit in accordance with a frame rate of a 
received image. 

12. A communication method according to Claim 10, 
wherein the change in information displayed on the display 
unit is a change in a state of display of an icon indicating 
a corresponding one of the plurality of communication ter- 
minals . 

13. A communication method according to Claim 11, 
wherein the notification is not performed when the frame 
rate is high, and is performed when the frame rate is 
reduced . 

14. A communication method according to Claim 8, 
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-wherein the notification comprises one of flashing of an 
icon, display of character information, and display of 
mimerals . 

15. A communication apparatus comprising: 

reception means for receiving a part or all of images 
generated from image generation units of a plurality of cor- 
responding communication terminals by switching the images; 

output means for outputting the images received by said 
reception means in order to display the images on a display 
unit as multiple images; 

assigning means for assigning an arbitrary image from 
among the multiple images; 

control means for controlling a state of outputting the 
image assigned by said assigning means; and 

notification means for grasping and notifying a state 
of reception of the image by said control means. 

16. A communication apparatus according to Claim 15, 
wherein the state of reception is information relating to a 
frame rate of an image being received by said reception 
means . 

17. A communication apparatus according to Claim 15, 
wherein said notification means changes the display unit in 
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accordance with the state of reception by said reception 
means . 

18. A communication apparatus according to Claim 15, 
wherein said notification means changes information dis- 
played on the display unit in accordance with a frame rate 
of an image received by said reception means. 

19. A communication apparatus according to Claim 17, 
wherein the change in information displayed on the display 
unit is a change in a state of display of an icon indicating 
a corresponding one of the plurality of communication ter- 
minals . 

20. A communication apparatus according to Claim 18, 
wherein said notification means does not perform notifica- 
tion when the frame rate is high, and performs notification 
when the frame rate is reduced. 

21. A communication apparatus according to Claim 15, 
wherein said notification means comprises one of flashing of 
an icon, display of character information, and display of 
numerals • 



22. A communication method comprising the steps of: 
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receiving a part or all of images generated from image 
generation units of a plurality of corresponding communica- 
tion terminals by switching the images; 

outputting the received images in order to display the 
images on a display unit as multiple images; 

assigning an arbitrary image from among the multiple 
images ; 

controlling a state of outputting the assigned image; 

and 

grasping and notifying a state of reception of the as- 
signed image. 

23. A communication method according to Claim 22, 
wherein the state of reception is information relating to a 
frame rate of an image being received. 

24. A communication method according to Claim 22, 
wherein the notification changes the display unit in accord- 
ance with the state of reception. 

25. A communication method according to Claim 22, 
wherein the notification changes information displayed on 
the display unit in accordance with a frame rate of a 
received image. 
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26. A communication method according to Claim 24, 
wherein the change in information displayed on the display- 
unit is a change in a state of display of an icon indicating 
a corresponding one of the plurality of communication ter- 
minals . 

27. A communication method according to Claim 25, 
wherein the notification is not performed when the frame 
rate is high, and is performed when the frame rate is 
reduced . 

28. A communication method according to Claim 22, 
wherein the notification comprises one of flashing of an 
icon, display of character information, and display of 
numerals . 

29. A storage medium storing a program, said program 
comprising : 

a reception process code of receiving images generated 
from a plurality of communication terminals; 

an output process code of outputting the received 
images in order to dipslay the images on a display unit as 
multiple images; and 

a notification process code of grasping and notifying a 
state of reception of the received images. 
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30. A storage medium storing a program, said program 
comprising : 

a reception process code of receiving a part or all of 
images generated from image generation units of a plurality 
of corresponding communication terminals by switching the 
images ; 

an output process code of outputting the received 
images in order to display the images on a display unit as 
multiple images; 

an assigning process code of assigning an arbitrary 
image from among the multiple images; 

a control process code of controlling a state of out- 
putting the assigned image; and 

a notification process code of grasping and notifying a 
state of reception of the assigned image. 



ABSTRACT OF THE DISCLOSURE 



There is the possibility that the operator misun- 
derstands as if an abnormality has occurred in an apparatus, 

5 depending on the state of reception of an image changing in 
accordance with situation- This problem is solved by provid- 
ing a reception unit for receiving images generated from a 
plurality of communication terminals, an output unit for 
outputting the images received by the reception unit in or- 

10 der to dipslay the images on a display vmit as multiple 
images, and a notification unit for grasping and notifying a 
state of reception of the images by the reception unit. 
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